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Abstract 

We consider the problem of optimal multi-modes switching in finite horizon, when the state of the system, 
including the switching cost functions are arbitrary {gij{t, a;) > 0). We show existence of the optimal strategy, 
and give when the optimal strategy is finite via a verification theorem. Finally, when the state of the system 
is a markov process, we show that the vector of value functions of the optimal problem is the unique viscosity 
solution to the system of m variational partial differential inequalities with inter-connected obstacles. 
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1 Introduction 

We consider a power plant which produces electricity and which has several modes of production, e.g., the lower, 
the middle and the intensive modes. The price {Xt)t>o of electricity in the market fluctuates in reaction to many 
factors such as demand level, weather conditions, unexpected outages etc. Moreover, electricity is non-storable 
once produced, it should be almost immediately consumed. Therefore, as a consequence, the station produces 
electricity in its instantaneous most profitable mode known that when the plant is in mode i G I, the yield per 
unit time dt is given by means of ip^{t, Xt)dt and, on the other hand, switching the plant from the mode i to 
the mode j is not free and generates expenditures given by gij{t, Xt) and possibly by other factors in the energy 
market. 

The switching from one regime to another one is realized sequentially at random times which are part of the 
decisions. So the manager of the power plant faces two main issues: 

(i) when should she decide to switch the production from its current mode to another one? 

(m) to which mode the production has to be switched when the decision of switching is made? 

The manager faces the issue of finding the optimal strategy of management of the plant. This is related with 
the price of the power plant in the energy market. 
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Optimal switching problems for stochastic systems were studied by several authors (see e.g. [2l [3l [5l fTO l [TT | [T2 l 
[131 [121 [ini HOI HH 131] and the references therein) . The motivations are mainly related to decision making in the 
economic sphere. In order to tackle those problems, authors use mainly two approaches. Either a probabilistic 
one [m [HI [50] or an approach which uses partial differential inequalities (PDIs for short) [21 M [IH [HI [311 HH] • 

In the finite horizon framework Djehiche et al. have studied the multi-modes switching problem in 

using probabilistic tools. They have proved existence of a solution and found an optimal strategy when the 
switching costs from state i to state j is strictly non-negative (g^ > a > 0). The partial differential equation 
approach of this work has been carried out by El Asri and Hamadene [T6|. We showed that when the price 
process {Xt : t > 0) is solution of a Markovian stochastic differential equation, then this problem is associated 
to a system of variational inequalities with interconnected obstacles for which we provided a solution in viscosity 
sense. This solution is bind to the value function of the problem. Moreover the solution of the system is unique. 

Using purely probabilistic tools such as the system of backward stochastic differential equations with oblique 
reflections (RBSDEs for short), Hamadene and Zhang [5T] have considered this optimal switching problem when 
the switching costs from state i to state j is non-negative gij . But in general case the optimal strategy may not 
exist. 

The purpose of this work is to fill in this gap by providing a solution to the optimal multiple switching problem 
using probabilistic tools and partial differential equation approach. 

We prove existence and provide a characterization of an optimal strategy of this problem when the payoff 
rates and the switching costs gij > are adapted only to the filtration generated by a Brownian motion. Later 
on, in the case when X is a solution of a SDE, we show that the value function of the problem is associated an 
uplet of deterministic functions {v^, . . . , u™) which is the unique solution of the following system of PDIs: 



where A an operator associated with a diffusion process and := I \ {i}. It turns out that this system is 
the deterministic version of the Verification Theorem of the optimal multi-modes switching problem in infinite 
horizon. 

This paper is organized as follows: In Section 2, we formulate the problem and give the related definitions. 
In Section 3, we shall introduce the optimal switching problem under consideration and give its probabilistic 
Verification Theorem. It is expressed by means of a Snell envelope. Then we introduce the approximating 
scheme which enables us to construct a solution for the Verification Theorem. Moreover we give some properties 
of that solution, especially the dynamic programming principle. Section 4 is devoted to the connection between 
the optimal switching problem, the Verification Theorem and the associated system of PDIs. This connection is 
made through BSDEs with one refiecting obstacle in the Markovian case. Further we provide some estimate for 
the optimal strategy of the switching problem which, in combination with the dynamic programming principle, 
plays a crucial role in the proof of existence of a solution for (|l.ip . In Section 5, we show that the solution of 
PDIs is unique in the class of continuous functions which satisfy a polynomial growth condition. In section 6 
some numerical examples are given. We close this paper an appendix in which some technical results are proved. 



(1.1) 



< 



min < Vi{t, x) — max {—gij{t, x) + Vj {t, x)} , —dtVi{t, x) — Avi{t, x) — ipii^, ( — 
V (t,x) e [0,T] X R'^-, i e 1= {l,...,m}, and v,{T,x)=0, 
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2 Assumptions and formulation of the problem 

Throughout this paper T (resp. fc, d) is a fixed real (rasp, integers) positive numbers. 
Let 

(i) b : [0, T] X R'' M*^ and a : [0, T] x M*^ ^ M'^^'' be two continuous functions for which there exists a constant 
C > such that for any t e [0, T] and x, x' G 

(2.1) |cr(t,a;) -cr(t,a;')l + Ht,x) - b(t,x')\ < C\x-x'\, 

{a) for i, j e I = {1, . . . , m}, : [0, T] x M*^ M and : [0, T] x K'"' ^ M are continuous functions and of 
polynomial growth, i.e. there exist some positive constants C and 7 such that for each i,j G T: 

(2.2) \i>^(t,x)\ + \g,j{t,x)\ < C(l + IxD, V {t,x) e [0,T] x R^ 
(im) for any (t, a;) G [0,T] x M'', gij{t,x) are satisfying 

(2.3) 5ij(i,a;) = 0, gij{t,x)>Q and gij{t,x) + gjkit,x) > gik{t,x), jy^i,kel, 

which means that it is less expensive to switch directly in one step from regime i to k than in two steps via an 
intermediate regime j. 

Moreover we assume that there exists a constant a > such that for any (t, x) £ [0, T] x R'^, 

(2.4) gij{t,x) + gji{t,x) > a, i^jel. 

This condition means that switching back and forth is not free. 

We now consider the following system of m variational inequalities with inter-connected obstacles: V i G X 



(2.5) 



min < Vi{t, x) — max {—gij{t, x) + Vj{t, x)} , ~dtVi{t, x) — Avi{t, x) — ipi{t, x) > = 0, 
Vi{T,x) = 0, 



where A is given by: 

(2.6) ; 

hereafter the superscript (*) stands for the transpose, Tr is the trace operator and finally {x,y) is the inner 
product of a;, y G R'^. 

The main objective of this paper is to focus on the uniqueness of the solution in viscosity sense of (|2.5p whose 
definition is: 

Definition 2.1 Let {vi, . . . ,Vm) be a m-uplet of continuous junctions defined on [0,r] x R'^, M.-valued and such 
that Vi{T, x) = for any x G R'^ and i G I. The m-uplet {vi, . . . , Vm) is called: 

(i) a viscosity supersolution (resp. subsolution) of the system V2. 5]) if for each fixed i € I, for any {to,XQ) G 
[0,T] X R*^ and any function (p.^ G C^''^{[0,T] x M*^) such that ipj^{to,XQ) = Vi{tQ,xo) and {tQ,xo) is a local 
maximum of ip^ — Vi (resp. minimum), we have: 
(2.7) 

min|wj(to,a;o) - max {-3,^(^0, a^o) + Vjito, xq)} , -dt(Pi{to, xq) - Ap>^{to,xo) - Vi(io,a;o)| > {resp. < 0). 
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(a) a viscosity solution if it is both a viscosity supersolution and suhsolution. □ 

There is an equivalent formulation of this definition (see e.g. [Bl) which we give because it will be useful later. 
So firstly we define the notions of superjet and subjet of a continuous function v. 

Definition 2.2 Let v G C((0, T) x R'^), (i, x) an element of (0, T) X R'^ and finally the set of k x k symmetric 
matrices. We denote by J'^'^v{t,x) (resp. J'^'^v{t,x)), the superjets (resp. the subjets) of v at {t,x), the set of 
triples {p, q,X) £R X R'^ X Sk such that: 

v{s,y) < v{t,x)+p{s-t) + {q,y- x) + ^{X{y~ x),y- x) +o{\s-t\ + \y- x\'^) 

{resp. v{s,y) > v{t,x) + p{s ~ t) + {q,y - x) + ^{X{y - x),y - x) + o{\s - t\ + \y - xf )). 

Note that if 1^9 — w has a local maximum (resp. minimum) at {t,x), then we obviously have: 

(Dtip{t,x), Dxip{t,x), Dl^ip{t,x)) e j'^'~v{t,x) (resp. J^'+v{t,x)).D 

We now give an equivalent definition of a viscosity solution of the parabolic system with inter-connected 
obstacles (|2.5p . 

Definition 2.3 Let {vi, . . . ,Vm) be a m-uplet of continuous functions defined on [0,r] x M'^, M.-valued and such 
that {vi, . . . , Vjn){T, x) — for any x £ R''". The m-uplet {vi, . . . , Vm) is called a viscosity supersolution (resp. 
subsolution) of S2. 5|) if for any i £l, {t,x) G (0,r) x R*^ and {p,q,X) <E ,P'^Vi{t,x) (resp. J^'^Vi{t, x)), 

min I Vi{t, x) — max {—gij{t, x) + Vj{t, x)), —p — -Tr[a* Xa] — {b, q) — ipi(t, x) I > {resp. < 0). 
I I- 2 J 

It is called a viscosity solution it is both a viscosity subsolution and supersolution. □ 

As pointed out previously we will show that system (j2.5l) has a unique solution in viscosity sense. This system 
is the deterministic version of the optimal m-states switching problem will describe briefly in the next section. 



3 The optimal m-states switching problem 
3.1 Setting of the problem 

Let {fl,J-^P) be a fixed probability space on which is defined a standard d-dimensional Brownian motion B = 
{Bt)o<t<T whose natural filtration is (J"" :— cr{Bs,s < i})o<i<T- Let F = {J-t)o<t<T be the completed filtration 
of {Tf)o<t<T with the P-nuU sets of J^. 
Let: 

- V he the (T-algebra on [0,r] x of F-progressively measurable sets; 

- M.^''' be the set of T'-measurable and M'^'-valued processes w = {wt)t<T such that El^"^ \ws\'^ds\ < 00 and 
be the set of 7^-measurable, continuous processes w — {wt)t<T such that £'[supj<7i \wt\'^] < 00; 

- for any stopping time re [0,T], %- denotes the set of all stopping times 9 such that t < 9 < T. 

Let I be the set of all possible activity modes of the production of a power plant. A management strategy 
of the plant consists, on the one hand, of the choice of a sequence of nondecreasing stopping times (t„)„>i (i.e. 
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Tn < Tn+1 and To = 0) where the manager decides to switch the activity from its current mode to another 
one. On the other hand, it consists of the choice of the mode which is an -measurable random variable 
taking values in I, to which the production is switched at t„ from its current mode. Therefore the admissible 
management strategies of the plant are the pairs {S,£_) :— ((t„)„>i, (^„)n>i) and the set of these strategies is 
denoted by V. 

Let X {Xt)Q<t<T be an T'-measurable, E'^-valued continuous stochastic process which stands for the 
market price of k factors which determine the market price of the commodity. Assuming that the production 
activity is in mode 1 at the initial time t — 0, let (ut)t<T denote the indicator of the production activity's mode 
at time t E [0,T] : 



n>l 

Then for any t < T, the state of the whole economic system related to the project at time t is represented by the 
vector: 



Finally, let ^pj^{t,Xt) be the instantaneous profit when the system is in state {t,Xt,i), and for i,j G I i ^ let 
gij{t,Xt) denote the switching cost of the production at time t from current mode i to another mode j. Then if 
the plant is run under the strategy ((5,^) = ((t„)„>i, (C,i)n>i) the expected total profit is given by: 



Therefore the problem we are interested in is to find an optimal strategy i.e. a strategy {5* ,C) such that 



Note that in order that the quantity J(S,^) makes sense, we assume throughout this paper that, for any 
i,j e I the processes {ilj^{t, Xt))t<T and {gij{t, Xt))t<T belong to M^'^ and respectively. There is one to 
one correspondence between the pairs (5,^) and the pairs {d,u). Therefore throughout this paper one refers 
indiflFerently to {S,£,) or {S,u). 

3.2 The Verification Tiieorem 

To tackle the problem described above Djehiche et al. [12] have introduced a Verification Theorem which is 
expressed by means of Snell envelope of processes. The Snell envelope of a stochastic process (?7f )t<T of (with 
a possible positive jump at T) is the lowest supermartingale R{r]) :— {R{i])t)t<T of such that for any t < T, 
R{'n)t ^ Vf It has the following expression: 



(3.1) 




(3.2) 



{t,Xt,ut) e [o,r] X r'' X z. 




J{S*,C) > JiS,0 for any {S,0 & 



y t <T, R{r])t — esssup£'[77^|J^t] and satisfies R{'q)T — Vt- 

reTt 



For more details owe refer to [JJ [T71 [H] . 



The Verification Theorem for the m-states optimal switching problem is the following: 



Theorem 3.1 Assume that there exist m processes (y* := (y/)o<t<T,i = 1, . . . ,to) of such that: 



(3.3) Vi < T, = esssupi; / V,(s, ^s)ds + max (-.g^- (r, X^) + r^^)l[^<T]|J^t ,Y^=Q. 




Then: 
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(i) Y^^ = sup J{5,u). 

(a) Define the sequence of F-stopping times S* — (t*)„>i as follows : 
rl = inf|,s>0, ni=^nmx^(-gi,(s,X,) + r/)|AT, 



inf <s>r;_i, Ys 



max (-g„^. ..(s, X^) + ^ A T, for n > 2, 



• - E il{ max (-5ifc(rt,X,.)+F'=.) = -ffi,(rt,X,.)+y;.}; 

jG I fee i-i 1 '^1 1 ^1 

• for anyn>l and t>T*^, y""" = J2 =j]^t 



for any n > 2, Ur* = I on the set 



withgu^, Jr*,Xr.)= =j]5jfe«,Xr;) andT\{uri_^} ^ 

T/ien the strategy {5* , m* ) satisfies 



E 



fc>l 



< +CX) 



and if is optimal, 
(ill) If 



E 



1<T\ 



k>l 



< +O0 



or gij is constant, then the optimal strategy [5* ,u*) is finite. 
Proof. The proof is divided in four steps 

Step 1. (i) It consists in showing that for any t <T, Y^, as defined by p.3p , is the expected total profit or the 
value function of the optimal problem, given that the system is in mode i at time t. More precisely, 



— esssup E 



i V'z(s, X,)ds - ^ 3ux,_i«., (t/c, Xr^)l[r^<T] 
fc>l 



where I?f is the set of strategies such that ti > t, P-a.s. if at time t the system is in the mode i. 
Let us admit for a moment the following Lemma whose proof is given in the appendix. 



Lemma 3.1 For every t\ <t <T . 



(3.4) 



Yf. ^ = esssup E 



T>t 



i'uAs,Xs)ds+ max (-g„^.j(r, X^) + >"^^)l[r<T] l-^t 



□ 
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From properties of the Snell envelope and at time t = the system is in mode 1, we have: 



= E 



E 



V'i(s,Xs)ds+ max (-5ij(ti,X^j) + y;'.)l[^.<T] 



Now, from Lemma |3. II and the definition of T2 we liave: 



YJ^ = E 



E 



i^u^,is,Xs)ds+ max (-g„^.j(T;,X..) + r/.)l[r-<T]l-7^Ti 



It imphes that 



Y„^ = E 



-E 



'ipiis,Xs)ds - (t*,X^j)1[^.<t] 
^ 



= E 

-giu^. iT*i,Xrl)llrl<T] - 9u^.u^. , X^- ) 1 <T] + Y^p l[r;<T] 

since [r^ < T] C [r| < T]. Therefore 



since between and t| (resp. r^^ and Tj) the production is in regime 1 (resp. regime Wt*) and then ut = 1 (resp. 
Ut — Ur*) which implies that 



'ip{s,Xs,Us)ds ^ / 'ipi{s,Xs)ds + / ip^^,{s,Xs)ds. 
Jo Jo JtI ^1 

Repeating this reasoning as many times as necessary we obtain that for any n > 0, 

yo k=i 

Then, the strategy {5* ,u*) satisfies 



E 



\<T] 



k>l 



< +00. 



If not Yq ~ — oo which contradicts the assumption Y^ E S^. Therefore, taking the limit as n — > +oo we obtain 
Yo' = J{S\u*). 



Step 2. (ii) We show that the strategy {S* ,u*) it is optimal i.e. J{5*,u*) > J{6,u) for any {S,u) G T>. 
The definition of the Sneh envelope yields 



^^0 > E 



> E 



[ ^i{s,Xs)ds+ niax(-gij(Ti,X^J +1;^ )l[^j<T] 
.Jo 

'4Ji{s,Xs)ds + (ri,X^J + r"r')l[Ti<T] 

But, once more using a similar characterization as (j3.4l) . we get 

i'u^As,Xs)ds + max (-.g„ .-(tz, X^J + yf'Jl[^2<T] l-7^ri 

^u^^ (S, Xs)ds + {-gu^^u^^ {T2,XrA + YrP )l[r2<T] \^r^ 

Therefore, 



> E 



+E 



■01 (s, X5)ds - giu^^ {Tl,Xr^ ) 

(t2 , X^.^ ) + Yr^ ^ ) 1 [t-2 <T] 

.Jo 

Repeat this argument n times to obtain 

n 

V'^, (S, )ds - ^ g„^^_ ^ (Tfc , )l[r^<T]+ Yr,:^ 1 <T] 

Finally, taking the limit as n — > +00 yields 

/ ^u, (S, X,)ds - 9u^^_^u^^ {Tk, Xrjl 

Jo 



= E 



Yo'>E 



fc=i 



yo>E 



k>l 



Hence, the strategy {6*,u*) is optimal. 

Step. 3 (iii) Next, we show that the strategy (r* )„>i is finite if 



E 



J29u^'r^,_STl,Xrl)l[rl<T] 
k>l 



< +00. 
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Indeed, let {uj : t*^{lu) < T, V n > 1}. If P{A) > 0, then from ([331) 'we have for any n > 1, 



< E 



-E 



= E 



k>l 

n 



\k=l 



< E 



n 



n 



since gij{t,x) + gji{t,x) > a. Then the right-hand side converge to — oo as n — !■ oo. But this is contradictory 
because belong to 5^, tpii-^X) G and E[J2k>i gu^.u^* ('''fcj -''^r* )1[t* <t]] < +oo- Henceforth the 

strategy is finite. 

Step 4. (iii) To complete the proof it remains to show that the strategy (t* )„>i is finite when gij is constant. 
Indeed let A = {w, t*^{uj) < T, V ti > 1}. If P{A) > 0, then from ([33]) we have for any 7i > 1, 

We show by induction on n that for all n > 1, 

(3.6) - X 5«,^_i«x-1k<t] < -a'^l[r-„<T]- 

Indeed, the above assertion is obviously true for n = 1. Suppose now it holds true at step n. Then, at step n+ 1, 
we have 



{7i~\-l)'m 



(n+l)r. 



fc=l 



fc=i 



fc— nmH-l 



It follow that 



E 



max \'^As,Xs)\ds-an\w. <ti + yr*""" l[r* <ti 



max \t\} As,Xs)\ds - an\w. <Tllyi - anlr^. l^r + K^/"'" Irr* <ti 



Then the right-hand side converge to —oo as n — )■ co. This contradicts the fact that belong to and 
e M?'^ . Henceforth the strategy is finite: P{A) = 0. 
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3.3 Existence of processes Y\ i = 1, . . . ,m 

The issue of existence of the processes Y^,. . . ,Y™ which satisfy (|3.3p is also addressed in [12]. Also for rt > 
let us define the processes (F^'", . . . , y™-") recursively as follows: for i E I we set, 

i-T 

■4'i{s,Xs)ds\Tt 



(3.7) 

and for n > 1, 

(3.8) r/^" = csssupS 

T>t 



= E 



0<t<T, 



tPi{s,Xs)ds+ max(-g,fe(r,X^) + y;='" ^)lr^<T,|J't 

feel-' ^ ' 



< i < T. 



Then the sequence of processes ((F^^", . . . , F™'"))n>o have the following properties: 
Proposition 3.1 ffW^. Pro. 3 and Th. 2) 

[i) for any i El and n > 0, the processes F^'", . . . ^y™'" are well defined, continuous and belong to , and 



verify 
(3.9) 



V t < T, y;^" < y;'"+^ < e 



max |V'i(s,Xs)| ^ ds|J^t 

l<2<m 



(n) t/iere exisf to processes , . . . , y™ o/ 5^ sitc/i t/iot for any i G I.' 
(a) V i < T, y/ lini„_^oo 



(6) yt< T, 

(3.10) 



E 



Yf = esssup E 



supirr-^;'" 

s<T 



as n — > +0O 



'ilji{s,Xs)ds + ma,x{-g.,k{T,Xr) + Y^)li^^T]\^t 

feel-' 



i.e. y^,...,y'" satisfy the Verification Theorem \3.1\ : 

(c) V i < T, 



(3.11) = esssup £; 

(<5,ji)ep; 



X^„)1[^^<T] > |.7^t 



where Vl ~ ~ ((t„)„>i, (^„)n>i) smc/i </ia< uq — i and ti > t}. This characterization means 

that if at time t the production activity is in its regime i then the optimal expected profit is Y^ . 
(d) the processes Y^ , . . . , Y™ verify the dynamical programming principle of the m-states optimal switching 
problem, i.e., ^ t < T, 



(3.12) y/ = esssup E 



l<fe<t^ 



Note that except {ii — d), the proofs of the other points are given in [T2]. The proof of {ii. — d) can be easily 
deduced using relation (|3.10p . From (|3.10p for any i El, t E [0,T] and {S,(,) E T>1 we have: 



(3.13) 



y;>e 



{Tk,XT-k)l[T^<T] +1[t„<T] 



l<k<r. 



Next using the optimal strategy we obtain the equality instead of inequality in (j3.13p . Therefore the relation 
([31^ holds true. □ 
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Remark 3.1 Note that the characterization 113.11]} implies that the processes Y^, . . . ,y" ofS'^ which satisfy the 
Verification Theorem are unique. 



4 Existence of a solution for the system of variational inequalities 

4.1 Connection with BSDEs with one reflecting barrier 

Let {t,x) e [0,T] X R'' and let (Xp) s<T be the solution of the following standard SDE: 

(4.1) dXl'"" = b{s, Xl^'')ds + cr(s, Xl^'')dBs for i < s < T and X*^^ = x for s < t 

where the functions h and a are the ones of (|2.1I) . These properties of a and b imply in particular that the process 
(X*'^)o<s<T solution of the standard SDE (|4.1I) exists and is unique, for any t £ [0, T] and x £ M*^. 

The operator A that is appearing in (|2.6I) is the infinitesimal generator associated with X*'^. In the following 
result we collect some properties of X*'^. 

Proposition 4.1 (JMEi) The process X^'^ satisfies the following estimates: 
(i) For any q > 2, there exists a constant C such that 



(4.2) 



E 



sup 

.0<s<T 



<c(i + N'). 



(ii) There exists a constant C such that for any t, t' £ [0, T] and x, x' £ 



(4.3) 



E 



sup 

0<s<T 



<C{\^\x\^){\x-x'\' + \t-t'\).U 



We consider a BSDE with one reflecting barrier introduced in [TB]. This notion will allow us to make the 
connection between the variational inequalities (j2.5p and the m-states optimal switching problem described in 
the previous section. 



Let/: [0,r]: 



I, h : [0,r]: 



and g 



. be continuous, of polynomial growth and such 



that h{x, T) < g{x). Moreover we assume that for any (t, x) £ [0, T] xR*^', the mapping {y, z) £ M}^'^ > /(t, x, y, z) 
is uniformly Lipschitz. Then we have the following result related to BSDEs with one reflecting barrier: 

Theorem 4.1 (]18^. Th. 5.2 and 8.5) For any {t,x) £ [0,T] x R'' , there exits a unique triple of processes 
(y*^^,Z*'^,X*'^) such that: 

Yt,x^j^t,x ^ g2 zt,x ^ ^2,d. j^ux -g non-decreasmg and if*'"' = 0, 



(4.4) 



Zl'''dBr + k!^'' - Kl'"", s<T 



Y^*'=' >h{s,Xl'''),\f s<T and [ {Y^*'=' ^ h{r, Xl'''))dK*''= = 0. 
^ Jo 

Moreover, the following characterization ofY^''^ as a Snell envelope holds true: 



(4.5) 



V s < T, r; 



esssup E 

reTt 



/(r, Xy-', Zy-')dr + h{T, X*'-)1[,<t] + 5(^T")l[r=T] l-F. 
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There exists a deterministic continuous function u : [0, T] x M'^ — > R with polynomial growth such that: 

Vse [t,r],i;*'- = «(s,x*'-). 

and the Junction u is the unique viscosity solution in the class of continuous function with polynomial growth of 
the following PDE with obstacle: 

miTi{u(t, x) — h{t, x), —dtu{t, x) — Au{t, x) — f{t, x, u(t, x), a{t, x)*\Iu{t, x))} = 0, 
u{T,x) = g{x)n 

4.2 Existence of a solution for the system of variational inequalities 

Let (Yg^'*'^, . . . , i^s™'*'^)o<s<T be the processes which satisfy the Verification Theorem 13.11 in the case when the 
process X = X*'^. Therefore using the characterization (|4.5I) . there exist processes K^^*'^ 

and Z"^'*'^, i E I, such that the triples (Y'^'^^^ ^ Z"^'*'^ , K"^'*'^) are unique solutions of the following reflected 
BSDEs: for any i — 1, . . . , m we have 

Yi,t,x^j^i,t,x g ^2 g^^^ 2i,t,x g j^2,d. j^i,t,x non-decreasing and isT^'*'"' = 0, 



(4.6) 



^,ir,X',^-)du^ 



Z'-^'^dBr + Kir.^'-" - Kt'^-'', < s < T, = 



i,t,x 



Yi,t.x > ^^ax {-gij{s,Xl'^) + y/^*'^), < s < T, 



i.t.x 



\ o&i 
Moreover we have the following representation of Y . 

Proposition 4.2 There are deterministic functions v^, . . . ,v"'' : [0, T] x M''' M such that: 

V {t,x) e [0,T] X R^Vs e [t,T]X''''' ^v\s,Xl^'=), i = l,...,m. 
and the functions w% i = 1, . . . , m, are lower semi- continuous and of polynomial growth. 



Proof: 

For n > let (F"'^'*'^, . . . , y"''"'*'^)o<s<T be the processes constructed in dSHll-dM]). Therefore using an 
induction argument and Theorem 14.11 there exist deterministic continuous with polynomial growth functions w*'" 
(i = 1, . . . , m) such that for any {t, x) G [0, T] x R*^, V s e [t, T], = u^«(s, X*'^). Inequality dSH) yields 



ri,i,t,x ^ -y^n+l,i,i ,2; 



< E 



j ( max \Us.Xr)\]ds\T^ 

Jt {l<t<-m J 



since ' ' ' is deterministic. Therefore combining the polynomial growth of f/'i and estimate (|4.2p for X we 
obtain: 

< v'-"+\t,x) < C(l + \x\P) 

for some constants C and p independent of n. In order to complete the proof it is enough to set v^{t^x) :— 
lim„_^oo v'-'"{t,x), {t,x) e [0,r] X R'= since y^".*^^ y^^*.^ as n-^00. □ 

We are now going to focus on the continuity of the functions But first let us deal with some 

properties of the optimal strategy which exist thanks to Theorem 13.11 
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Proposition 4.3 Let {5,u) = ((t„)„>i, (^„)„>i) be an optimal strategy finite, then there exist two positive 
constant C and p which do not depend on t and x such that: 



(z) ifE 



fc>l '--^ 



< +CX), then 



(4.7) 

(m) // gij is constant, then 
(4.8) 



V n > 1, P[t„ < T] < 



c(i + Nf) 



V n > 1, P[r„ < T] < 



mC(l + \x\P) 



Proof, (i) We will show by contradiction, suppose 3 ng, V rii > no, P[t„j < T] > 
Recall the characterization of p. lip that reads as: 



Fq ' '"^ = esssup E 



•^0 k>l 



If {5,u) = ((t„)„>i, (Cn)n>i) is the optimal strategy then 



E 



k>l 



fe>i 



fc>l 

Taking into account that gij + gji > a for any i j and for any k < ni, [r„j^ < T] C [t^: < T] we obtain: 

5Z 5«.,u,,_i ^rf)l[rfe<T] 



k>l 



< E 



< E 



^j.Ar,Xl'^)dr 



V^„„(r,X;'-)dr 



■ niaP[T„, < T] 

c(i + Nf) 



nia- 



As ni is arbitrary then putting ni — > +cx) to obtain: 



fe>l 



< — OO, 



which is a contradiction. 

(ii) If {5,u) ~ ((t„)„>i, (^„)n>i) is the optimal strategy and gij is constant then we have: 

(•T 



< E 



fe>i 

/ i^u,Xr,Xl^^)dr-Ygu^^ ^„^^1[^^<t] 
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From p.6|) we have: 



y^i,t,^ < E 



Then, 



J- n 



< E 



Yr 







Remark 4.1 T/ie estimate 1^. 7p and ( [/^.<^[ ) are aZso valid for the optimal strategy if at the initial time the state 
of the plant is an arbitrary i G I. □ 



Next, for i E I, let {yl'*'^ , zl'*'^, fc^'*'^)o<s<T be the processes defined as follows: 

yi,t,x^ ^i,t,x g ^2 ^iA,x g _A/(2,d. j^i,t,x jg non-decreasing and fep*'"" = 0, 



(4.9) 



y^,t,x > ^M.x .= max V s, X*;^J + yi^*'-)}, V s < T, 



0. 



The existence of (y*'*'^, z*'*'^, fc*'*'^), i € X, is obtained in the same way as the one of (y*.*.^:^ 2'*'*'^, if*'*'^). By 
uniqueness we obtain for any {t, x) G [0, T] x M*^, for any s G [0, t] we have yl'*'^ = y^"^'^ , zl'''^^^ — and fc*'*^^ = 0. 



We are now ready to give the continuity of the value functions, when the strategy optimal is finite. 

Theorem 4.2 The functions {v^, . . . , w™) : [0, T] x M'' — > K. are continuous and solution in viscosity sense of the 
system of variational inequalities with inter- connected obstacles \2.5\] . 

Proof. The continuity of the value functions follows from the dynamic programming principle and is proved 

in [ig.n 

5 Uniqueness of the solution of the system 

In this section we address the main question of this paper, that is uniqueness of the viscosity solution of the 
system (|2.5|) . 

Theorem 5.1 The solution in viscosity sense of the system of variational inequalities with inter- connected ob- 
stacles i2. 5]) is unique in the space of continuous functions on [0, T] x K*^ which satisfy a polynomial growth 
condition, i.e. in the space 

C := {(^ : [0,7"] x M'^ — )• M, continuous and for any {t,x), \ip(t,x)\ < C(l + \xp) for some constants C and 7} . 
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Proof. The proof is divided in four steps. We will show by contradiction that if ui, . . . ,Um and wi,. . . ,Wm 
are a subsolution and a supersolution respectively for (j2.5p then for any i — 1, . . . ,rn, < Wi. Therefore if 
we have two solutions of (I2.5P then they are obviously equal. Actually for some R > suppose there exists 

a; I < R}) such that: 



{t,x,l) e (0,T) xBnxI {Br := {x e 



(5.1) 



max {ui{t, x) — Wi{t, x)) ~ uj{t, x) ~ wi{t, x) — rj > 0. 



Step 1. Let us take 0, A and /3 e (0, 1] small enough, so that the following holds: 



(5.2) 



6 



_ ^ 

-Awj(t,x) < - 
A ri 

. /- _N ?7 

A max (;ji(<, x) < — . 

i^j 6 



Here 7 is the growth exponent of the functions which w.l.o.g we assume integer and > 2. Then, for a small e > 0, 
let us define: 



1 



A 



(5.3) 'flit, X, y) = u^it, x) - w^{t, y) ~ y^Qx - + \x ~ + (i - Z)^'') - 0(|xp^+2 + |2/|2^+2) + - - 

where, w^{t,x) = (1 — X)w{t,x) + Xai and a; = minjfzx-i gji{t,x). By the growth assumption on m and Wi, 
there exists a (io, a;o, yo, io) G (0, T] x Br x _B/f x I, such that: 

K''{to,xo,yo) = max $^(i,a::,?/). 

{t,x,y,t) 

On the other hand, from ^l°{to,xo,yQ) > ^1° (i,x,x), we have 

(5.4) ^{\xo - yol'^ + \xo-x\^'' + {to-tf) < Mto,XQ) - u,,{t,x)) + (<,(Z,x) - <,(io,yo 

-e{\x,\^'^+' + |yoP^+^ - 2|afp^+2) + /?(t„ - i) - ^ + ^ 

to t 



and consequently ^(|xo — yoP'^ + |a;o + (^o — i)^'') is bounded, and as e -> 0, Ixq — yo| — > 0, Ixq— 5;| — )• and 
(tQ — t) . Since Ui^ and are uniformly continuous on [0,T]x Br, then ^ ( | a;o ~ J/o P''' + 1 a^o — S^P''^ + (io ^ ^ ) ) 
as £ 0. 

Step 2. We now show that to < T. If to = T then, 

$^(t,x,x) <$?(T,a;o,yo), 



and, 



uj(t, x)^{l- X)wj{lx) - 20\x\''^+^ + lit~^< Aa,„ + /3T - -, 



since Ui^ {T, xq) = Wig (T, yo) = and aj > 0. Then thanks to (|5.1I) we have, 



r? < -A«7j(t,x) + Aa,o + 26*1x1 



27+2 
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which yields a contradiction and we have to S (0,T). 
Step 3. We now claim that: 

(5.5) Ui„{to,xo) - max {-^ioj (*o, a^o) +Uj{to,xo)} > 0. 



Indeed if 



Uio{to:Xo) - max {-gi„jito, xq) +Uj{to,xo)} < 



then there exists fc G I such that: 

Uio(.to,Xo) < -giokito,Xo) + Uk{to,Xo)- 

Now, we then see that 

WiAto,yo)- max (-.g^oj (^o, yo) + w^(to, yo)) 

= Xaio + (1 - A)u;i„(to,2/o) - max [(1 - X){-gi„j{to,yo) + Wj{ta,yQ)) + Xaj ~ Xgioj{to,yo)] 

(5.6) 

> (1 - X)[wi„{to,yo) - max {-gigj{to,yo) + Wj(io, 2/o))] + A(aio - max {aj - gigj{to,yo)) 

> X{aio + min (^ioj (^o, 2/o) - "j), 

let «i e such that aig — gi^ig{t,x) and set Z2 G such that 

min {gigj{to,yo) - a^) = giai2{h,yo) ~ a»2- 



Then we have 



Qfio + min {giaj{tQ,yQ) - aj) = gi^i„{t,x) + giai^ito.yo) - Oii 



= .9iiio a:^) + .9*0^2 (^7 x) - gigi^ {t, x) + gi„i^ {to, yo) - a^^ 
= V - gioi-i {t,x) + gi„iAto,yo) 

where 

^ = 9iiio (t, + gioi^ a, x) - min gj^^ (t, x) > gi^t^ {t, x) - min gj^^ (t, x) > 0. 
From ()5.6p we have 

'Wi„{to,yo) - {-giok{to,yo) + Wk{to,yo)) > Xi^ - Xgig,^{t,x) + Xgi„iAto,yo). 

It follows that: 

Uta{to,xo) - ■Wi^{to,yo) - {uk{to,xo) - Wk{to,yo)) < -Xiy + XgigiAt,x) - XgigiAto,yo) + giok{to,yo) ~ giok{to,xo). 
Now taking into account of (|5.3p to obtain: 

^l°{to,xo,yo) - ^eito,xo,yo) < -Xv + Xgi„i^{t,x) - Xgi„i^{to,yo) + gi„k{tQ,yQ) - giok{to,xo)- 

But this contradicts the definition of io, since gi^i^ and gi„k are uniformly continuous on [0,r] x Bfi and the 
claim (|5.5p holds. 

Step 4. To complete the proof it remains to show contradiction. Let us denote 

(5.7) ^,{t, X, y) = ^(k - yf^ + \x- xf-^ + {t- tf-^) + 0(|x|2^+2 + |y|27+2) -pt+-^. 
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Then we have: 



D,ip^{t,x,y) = ^{x- y)\x - yl^^^-^ + ^ix-x)\x- x\^^-^ + e{2j + 2)x\x\^\ 



Dy^,{t, x,y) = -j{x-y)\x- yp^-^ + ^(2^ + 2)y\y\^\ 



(5.8) <; B{t,x,y)=Di^ip^{t,x,y)^ - \ 

£ \ -ai{x,y) ai{x,y) 



02(2;)+ 03 (x) 

02(2/), 



with aiix, y) = 7|a; - yp-'-^j ^. ^(2^ _ 2)(2; - - yY\x - y\^^'\ 



a2{x) = 61(27 + 2)|x|2t/ + 26(7(27 + 2)xa;*|x|2T-2 and 



03(2;) = - x|2t-2/ + 2i^2_^(a; _ _ x)*\x - xp-i--^. 



Taking into account (|5.5p then applying the resuh by Crandall et al. (Theorem 8.3, [6j) to the function 

Ui„{t,x) - wl{t,y) - Lp^{t,x,y) 
at the point (Iq, xq, 2/0)1 for any ei > 0, we can find c, d G M and X, F e 5^, such that: 

(c, ^(xo - yo)ko - yol'^"' + 7(^0 - S)|a:o - ^P^"' + ^?(27 + 2)xo|a;oP^, ^) e j2>+(?/,„ (io, xq)), 

(-d, J(a;o - yo)\xo - yoP^-' - ^(27 + 'i)vo\yo?\ Y) e J2-« (io, yo)), 

(5.9) <( A 7 - - _ 

c + = Dtip^{h,xo,yo) = - -2 + -(to - i)(io - t)^'' ^ and finaUy 



— + ||S(to,a;o,yo)|| V ^ f ^ \ < B{to,xo,yo) + eiB[to,xo,yof 



By (j5.5p . and the definition of viscosity solution, we get: 



~c - l^Trla* {to, xo)Xa{to, xq)] ~ -0^^ (io, xn) 



( J(a;o - 2;o)|2:o - yo|'^"' + 7(2^0 - S)No - + ^^(27 + 2)a:o|xo|'^ 6(to, a^o)) < 

and d - irr[(T*(to, yo)>^o'(io, 2/o)] - (1 - •^)i/'io(*0' 2/o) 
I J(a;o - 2/o)ko - yo|'^"' - ^(27 + 2)2/o|2/o|'^ K^o, J/o)) > 
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which implies that: 

(5.10) -c-d < ^Tr[(T*{to,XQ)Xa{tQ,xo) - a*{to,yo)Ya{to,yo)] 



+ (j^{xo - yo)\xo - yof^ '^,b{to,xo) - 6(io, J/o)^ 

+ (^^{xo - x)\xo - aJp^-', 6(io,a:o)) + {d{2-f + 2)xn\xn\^\b{to,xn)) 

+ (0(27 + 2)yo\yo\^\b{to, yo)) + ^.(io, xo) - (1 - A)V',(to, yo)- 



But from (|5.8p there exist two constants C, Ci and C2 such that: 

||ai(a^o,2/o)ll < C\xo - (ll«2(a;o)ll V < C.O and ||a3(xo)|| < ^\x^-x\'-<-\ 



As 

1 ( ai(a;o,j/o) -ai(a;o, 2/0) \ / a2(a;o) + a3(xo) 
-ai(xo,yo) ai(a::o,2/o) /I a2{yG) . 



B = B{to,xo,yo) 

e 



then 



B<-\xo-y,\'-<-'\ ^ ^\+c,ei+^\xo~x\^''-^i. 

£ \-I I £ 



It foUows that: 



(5.11) B + e^B' < C{-\xo~yo\'''-^ + ^\xo-yo\'''-*)i ^ ^ 

+Ci9I + C2{-\xo - x\^"'-^ + %|xo - x\^^-^)I 
where C, Ci and C2 which hereafter may change from hue to hue. Choosing now ei = e, yields the relation 

(5.12) B + SiB^ < |(|xo-2/oP^-' + |xo-2/o|'^-') 



i\xo-x\'-'-' 

£ 





-/ 








-4)/. 



Now, from (HH]), and ((5l^ we get 

1 



^Tr[a*{tQ,Xi^)Xa{tQ,XQ) ~ cr* {to,yo)Ya{to,yo)] 
< ^{\x,-yo\'^ + \xo-yo\'-'-') 

£ 

+C,6{1 + |xo|2 + |yo|') + — (|xo - n^''-^ 

£ 

+ |xo-x|4''-4)(l + |xop + |yon, 



Next, 



and finally. 



(j(a;o - 2/o)|a;o - yo?'' ^,b(to,Xo) - &(io,yo)) < — l^^o - 
(J(xo-x)|xo-a;p'^-2^6(to,xo)) < j\xo - xf^-^\xo\ 

(0(27 + 2)a;o|xoP^ 6(^0, xo)) + {6(2^ + 2)yo\yo\^\b{to, yo)) < 0C{1 + \xo\^^+^ + |yo|'^+'). 
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So that by plugging into (|5.10p and note that A > we obtain: 

P < j{\ooo-yo\''' + \^o-yo\"'-^) + C,9{l + \xo\' + \yo\') 

+^{\xo - + \xo - x\^'>-'){l + |xop + lyoH + —\xo - yo\^^ 

£ £ 



+V'zo(*o,a;o) - (1 - A)-!/'i„(io,yo)- 



By sending e— >-0, A— >0, 0— ?>0 and taking into account of the continuity of ipia and 7 > 2, we obtain ^9 < 
which is a contradiction. The proof of Theorem 15. II is now complete. □ 
As a by-product we have the following corollary: 

Corollary 5.1 Let (w"'^, . . . , u™) be a viscosity solution of \2. 5)] which satisfies a polynomial growth condition 
then for i ~ 1, . . . ,m and (t, x) £ [0, T] x R'"', 



v^{t,x) = esssup E 
('5,«)ex'j 



6 Numerical results 



<T] 



We consider now some numerical examples of the optimal switching problem (|2.5p . 



Example 6.1 In this example we consider an optimal switching problem with two modes, where 

T ^ 1, b^ X, a = V2x, gi2{t,x) = 0, 321(^,2:) = 0.1|a:| + 0.5< + 2, ipi{t,x) ^ x + 0.75t + l, ip2(t,x) = O.lx + t- 1 

Example 6.2 We now consider the case of 3 modes where T = 1, b = x, a = y/2x, gi2{t,x) — 0, gi3{t,x) ~ 0, 
92i{t,x) = |x| + t + 4, .923(^,2;) = 0, 331(^,2;) = \x\+t + l, gz2{t,x) = At + 0.5, ^l^i{t,x) = x + 2t + 1, 
ip2{t^ 2;) — —X + t — 2 and finally ^p^it, x) — —a; + t — 2. 



7 Appendix 



Proof of Lemma 13.11 From p.3p we have for any i e I and < t < T 
(7.1) r/== esssup £; 



'ipi{s,Xs)ds + max (-g,y(r,X^) +Y^)l[r<T]\J^t 

t ' 



This also means that the process (F/ + /J '^l^^{s,Xs)ds)Q<t<T is a supermartingale which dominates 

f / ^,{s,X,)ds+ max(-gy (t,Xt) +y/)l[t<T]) 
This implies that the process (l[„^,^i](y/ + J^, -0^(5, Xs)(is))i>T-j is a supermartingale which dominates 



0<t<T 



l[„^.=i] / V'iCs, max(-g,y(s,Xf) +r/)l[4<T] 
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X 



Figure 1: Surfaces of and . 
Since I is finite, the process (X^igx l[jv*=i] O^t + /r* Xs)ds))t>Ti is also a supermartingale which dominates 



-0^(5,^3)^3 + max (-gy(t,Xt) + r/)lrt<T] 



t>r? 



Thus, the process + J^, , (s, Xs)(is)t>T* is a supermartingale which is greater than 



' i^u ,{s,Xs)ds+ max (-^^^.^(t, Xt) + y/)l[t<T] 

To complete the proof it remains to show that it is the smallest one which has this property and use the 
characterization of the Snell envelope see e.g. [H [T71 119) . 

Indeed, let {Zt)o<t<T be a supermartingale of class [D] such that, for any <t <T, 

Zt> f ,is,X,)ds+ max + r/)l[t<T]. 

It follows that for every tI < t <T, 



Mu^,=z]Zt > ^u^,=^] yj ^'0i(s,^s)ds+ max(-.gjj(t,Xt) + y/)l[t<T]J . 
But, the process {'i-[u^t=i]Zt)t>Ti is a supermartingale and for every t > tI, 



Mu^,=t]Yt = esssup£; 

1 T>t 
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X 



Figure 2: Surfaces of , v'^ and . 

It follows that, for every t\ <t <T, 
Summing over i, we get, for every < t < T , 

Hence, the process {Y^ + J^. , {s,Xs)ds)t>Ti is the Snell envelope of 




which completes the proof of the Lemma. □ 
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